Traces and determinants of strongly stochastic operators 



C. P. Dettmann 
Niels Bohr Institute, Blegdamsvej 17, 2100 K0benhavn 0, Denmark 
dettmann&nbi. dk 
(February 5, 2008) 



00 



> ■ 

o\ : 
^ , 

o ■ 

\o • 

o 

00 : 

On . 
I ' 

o : 

^ . 



Periodic orbit theory allows calculations of long time prop- 
erties of chaotic systems from traces, dynamical zeta functions 
and spectral determinants of deterministic evolution opera- 
tors, which are in turn evaluated in terms of periodic orbits. 
For the case of stochastic dynamics a direct numerical evalua- 
tion of the trace of an evolution operator is possible as a mul- 
tidimensional integral. Techniques for evaluating such path 
integrals are discussed. Using as an example the logistic map 
f{x) = Aa;(l — x) with moderate to strong additive Gaussian 
noise, rapid convergence is demonstrated for all values of A 
with strong noise as well as at fixed A = 5 for all noise levels. 

PACS: 05.45. +b 02.50.Ey 02.60. Jh 



I. INTRODUCTION 

Periodic orbit theory is a remarkable tool in classi- 
cal and quantum ^,|| chaotic systems, permitting 
the evaluation of long time properties, such as escape 
rates, dynamical averages and energy levels in terms of 
short unstable recurrent motions, that is, periodic orbits 
or "cycles" . In classical hyperbolic systems with known 
topology, such as the repeller of the map 5x{l — x) dis- 
cussed below, convergence can be impressive: the escape 
rate is computed to 9 digits from the 8 cycles of period 
4 or less. The lowest energy levels of helium are com- 
puted to an accuracy far better than would be expected 
from a semiclassical approximation. Even when there is 
intermittency, hence hyperbolicity is lost, it is possible to 
get sensible results using special techniques in both the 
classical and quantum |^ cases. 

Recently the theory has been extended to classical 
systems with weak additive noise, using Feynmann di- 
agrams or smooth conjugacy techniques There 
are a number of motivations for such extensions: noise 
at some level is present in all physical systems; it regu- 
larizes the theory, replacing Dirac (5-functions by smooth 
kernels (see below) and fractal distributions by smooth 
functions; there is also some hope that the noise may ef- 
fectively truncate the theory, rendering irrelevant contri- 
butions from periodic orbits longer than the finite mem- 
ory of the system. 

The result of these investigations is a weak noise per- 
turbation theory, representing the trace of the evolution 
operator and derived quantities as a power series expan- 
sion in (T, the noise level. The coefficients are combi- 
nations of higher derivatives of the map evaluated at 



the periodic orbits of the deterministic unperturbed sys- 
tem. Numerically, the coefficients themselves converge at 
a similar rate to the classical periodic orbit theory, but 
the power series in a is useful only for weak noise, say 
a < 0.03, suggesting the following question, the subject 
of this paper: 

To what extent does periodic orbit theory survive strong 
noise, and how fast does it converge? 

Strong noise differs qualitatively from weak noise in a 
number of respects: The stochastic dynamics is equally 
close to many slightly different deterministic dynamical 
systems, so the concept of a unique perturbation theory 
becomes less defined, in addition to the lack of conver- 
gence of such a theory. Also, Gaussian noise has no pre- 
ferred status; for weakly stochastic systems, all types of 
noise distributions with a given variance cr^ are identical 
to order . 

The approach taken here is that the relevant quantity, 
the trace of an evolution operator, is evaluated numer- 
ically, using very little detailed information about the 
dynamics, in particular without reference to periodic or- 
bits. The method is general enough to include any type of 
dynamics (hyperbolic, intermittent, attracting) and un- 
correlated noise, subject to smoothness of both dynamics 
and the noise distribution, with the latter decaying expo- 
nentially at large distances. Here, as in Refs. the 
noise is additive, but this is not a necessary condition. 

From the trace, it is straightforward to construct the 
spectral determinant, and hence highly convergent ex- 
pansions for escape rates and dynamical averages, in the 
spirit of cumulant expansions, as in standard periodic or- 
bit theory. This has some similarities to Ref. where 
various approximations to the quantum trace are com- 
pared. 

Section || outlines the formalism required for the cal- 
culation, in particular casting the trace as a multidi- 
mensional integral. Section III discusses numerical ap- 
proaches for evaluating this integral. Finally, the results 
and their ramifications are discussed in Section IV. 



II. FORMALISM 

The goal is to determine the long time properties of 
stochastic dynamical systems, here one dimensional maps 
with additive noise: 



Xn+l = /(a 



(1) 
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where f{x) is a known function, for example the logistic 
map 



f{x) ^ Xx{l - x) , 



(2) 



(7 is a measure of the strength of the noise, and f„ are in- 
dependent identically distributed random variables with 
unit variance. 



(3) 



such as a normalized Gaussian distribution. The meth- 
ods used here are equally applicable to a and ^ that de- 
pend on X, and non-Gaussian noise distributions. 

Instead of the Langevin form (|^) it is more conve- 
nient to consider the discrete Fokker-Planck equation for 
a probability distribution p(x) transported by the dy- 
namics and diffusing due to the noise: 

Pn+l{x) = C[pn]{x) = / Sa{x- f {x')) Pn{x')dx' (4) 



(5) 



reducing to a Dirac 5 in the deterministic a = limit. 

Long time properties of the dynamics are obtained 
from the leading eigenvalue(s) of the linear evolution op- 
erator £, which are (the inverses of) solutions of the char- 
acteristic equation 



where 5a{y) is the noise kernel, for example 



det(l - z£) = 



(6) 



For example, the probability of a point initially in an 
open system remaining there after n iterations is typically 
proportional to e^''" where the escape rate 7 is related 
to the leading zero zq by 



7 ^ 



In zo 



(7) 



Dynamical averages and diffusion coefficients can be ob- 
tained from the leading zero of appropriately weighted 
evolution operators . 

The spectral determinant of an infinite dimensional 
operator may be defined by its cumulant expansion in 
powers of z, using the matrix relation Indet — trln and 
Taylor expanding the logarithm: 



det(l — zC) = cxp I — ^ — tr£ 



1 - ztvC + — [{trC)^ - tr£2] 



(8) 



Cn may be obtained from all the traces tr£™ with m < n, 
and an approximation for zq is obtained by numerical 



root finding on the n'th degree polynomial given by the 
truncation of the determinant. The above expression for 
Cn quickly gets complicated; it is easier to expand the 
derivative 



-z— det(l-z/:) =det(l-z/:)^z"tr/:" , (9) 

n—l 

which leads to the recursive equation 



^n = - I tr/:" - V c„tr/:"-™ ) 



(10) 



The trace is straightforward to write down as an n- 
dimensional integral, a discrete periodic chain reminis- 
cent of a path integral, obtained in Ref. [13| , 



/n — 1 n—l 
n n ^cr{xj+i 

J=0 J=0 



(11) 



where the index j is cyclic, so x„ — xq. In the noiseless 
(ct = 0) limit, the integrand is a product of Dirac S- 
functions, and the trace is given by a sum over the fixed 
points of /", that is, the n-cycles of /. In Refs. 1 10 1^ the 
weak noise limit is obtained by a saddlepoint expansion 
of the integral around these cycles. Here, the integral is 
performed numerically, up to n = 5, as described in the 
following section. 



III. NUMERICAL METHODS 

The required quantities, trC", are n-dimensional in- 
tegrals, which in the case of weak noise (cr ^ 1) have 
a large number of sharp peaks surrounding the periodic 
points of the deterministic map. Obtaining an accurate 
numerical estimate of the integral for any n > 2 seems 
prohibitively difficult, since Monte Carlo approaches take 
too long to converge, and direct integration schemes re- 
quire a small step size, but cover a large configuration 
space. See Ref. [Q for more discussion. 

In the case of Gaussian (or similar) noise and smooth 
dynamics f{x) the integrand is smooth and decays expo- 
nentially fast at the boundaries. This in turn implies that 
the simplest possible integration algorithm, summing the 
integrand at a cubic array of coordinate values, converges 
faster than any power of the step size, and is typically 
exponential once the step size is smaller than a. 

This remarkable convergence rate for smooth, expo- 
nentially decaying integrands follows from the observa- 
tion that by multiplying the terms near the boundary by 
appropriate factors, it is possible to obtain algorithms 
of higher and higher order in the step size [ p^ . Expo- 
nentially decaying integrands are impervious to any such 
coefficients, and so converge faster than any power of the 
step size. 
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Note also, that having chosen, say xq and Xi, and the 
argument of the exponential, —{xi — /(xo))^/(2(T^) hap- 
pens to be too small, it is not necessary to consider the 
other Xj . This provides a very substantial saving in time 
for n > 2. 

Finally, the integral is symmetric under a cyclic inter- 
change of the Xj: this implies an additional saving of a 
factor n. The logic required here is not trivial since the 
contribution differs depending on whether some of the Xj 
are identical. For example, for n = 4, choose two values 
Xmin and Xmax beyoud which there is no possible con- 
tribution. Then sum Xmin ^ xq < x^ax, defining xq to 
be the largest of the Xj, and the one occurring first, if 
more than one are maximum. Sum Xmin Xi < xq, 
checking that the argument of the exponential is not too 
small. Sum Xmin ^ X2 < xq, again checking the argu- 
ment of the exponential. Then sum Xmin ^2:3 < xq, and 
multiply each contribution by 4. If X2 = a^o the Xj could 
form a 2-cycle repeated twice, so when X3 = xi count the 
term twice instead of four times, and stop the sum over 
X3 to avoid double counting. Finally, the repeated fixed 
point Xq = Xi = X2 = X3 has been excluded, so sum this 
explicitly and count it once. The case n = 5 is simpler as 
there is only a repeated fixed point, but there are more 
possibilities for which of the Xj are maximum. 

Even with the above short cuts, large n, small a, 
and stringent precision requirements can lead to sums 
of 10^ terms. This means it is advisable to group them 
in size (using the argument of the exponential) as they 
are summed, then combine the groups from smallest to 
largest to minimize roundoff error. 

Given the above algorithm the step size h is decreased 
until two successive estimates agree to within a specified 
precision (for example 10 digits). Since the amount of 
time increases as the optimal sequence is probably 
hj = /iQe^-'/". Note that large initial values of h can lead 
to a zero result as the entire contribution region may be 
missed. 

With the above algorithm, calculation of the trace up 
to 71 = 5 with a > 0.01, and n = 6 for somewhat higher 
values of a, is feasible for the case of Gaussian noise and 
smooth one dimensional dynamics. 

IV. RESULTS 

The logistic map f{x) — \x{\ — x) for various values 
of A exhibits most of the behaviors observed in one di- 
mensional maps. For all A > 1 any initial x outside the 
range [0, 1] ends up at —00, while the behavior of points 
within this range depend of A as follows: For < A < 1, 
the point a; = is a stable fixed point, marginally so at 
A = 1, and then unstable for A > 1. For 1 < A < 3, the 
fixed point x ^ 1 — 1/Ais stable, and then bifurcates to 
a stable cycle of period 2. This cycle in turn becomes 
unstable, bifurcating to a 4-cycle, then an 8-cycle, and 



so on, to A « 3.57 at which point a chaotic attractor 
forms. The period doubling cascade in the presence of 
weak noise may be described by the renormalization ap- 
proach of Ref. ||l^. At larger values of A more stable 
cycles are created, including a 3-cycle which is stable at 
A — 3.84, leading to a pattern of alternating stable "win- 
dows" surrounded by non-attracting unstable cycles and 
chaotic attractors containing many unstable cycles. At 
A = 4 the attractor fills the interval [0,1], and in this 
case, the Ulam map, the dynamics is exactly solvable. 
For A > 4 almost all initial conditions leave the inter- 
val, but infinitely many unstable cycles remain, forming 
a fractal repeller, with a well defined escape rate. 

Imposing additive noise to the logistic map leads to 
escape for all A > 0, although this may be very unlikely 
if a is small. At A = 2, for example, every point (except 
the endpoints) is attracted to the stable fixed point at 
X — 1/2, and the noise must move the trajectory out of 
the interval to escape. In cases like this, the stochastic 
behavior is analogous to quantum tunneling, and is expo- 
nentially suppressed for small a. At bifurcation points, 
including A = 1, the stability of the relevant cycles is 
marginal, leading to intermittency. Marginal cycles are 
difficult to treat using cycle expansions, and it is one of 
the goals of this work to understand how this poor con- 
vergence is modified by the presence of noise. 

The results of numerical evaluation of tr£" up ton ^ 5 
are shown in Tab. |. The spectral determinant is eval- 
uated using (p^, and C5, the coefficient of is noted. 
Since for the parameters shown the first zero of the deter- 
minant is close to 1, — logj^Q jCsl gives roughly the num- 
ber of significant digits of z, and hence the escape rate, 
evaluated to n = 4. It also gives the approximate range 
of z over which the n = 4 approximation is valid. 

It is seen that, for the trivial case A = 0, corresponding 
to pure noise, and for strong noise a — 1, the calculation 
is limited by the double precision arithmetic: evaluation 
of the trace beyond n = 4 is superfluous at this level of 
precision. Almost as precise is the case A = 5 which has 
a repeller with complete binary symbolic dynamics in the 
absence of noise, and hence is an ideal candidate for cycle 
expansion methods. Nine significant digits are obtained 
at n = 4, corresponding to just 8 cycles. The presence of 
noise makes methods based on enumerating these cycles 
more difficult ||lo| , pT[| , but convergence is rapid at any 
noise level. 

The other cases, where escape is induced by the pres- 
ence of noise, do rather poorly for small noise. The sig- 
nificance of A = 1,2,3,3.57,3.84,4 are discussed above; 
the other values in Tab. ^ are A = 3.5 which contains 
a stable 4-cycle, and A = 3.72 which is not near any 
large stable window, and numerically exhibits a chaotic 
attractor, although mathematical proof is difficult. The 
nature of the underlying attractor seems to have little 
effect on the rate of convergence, except that the inter- 
mittent case (A = 3 and particularly A = 1) is divergent 



3 



at (T = 0.01 to this level of approximation; the escape rate 
probably converges at impossibly large n, either for the 

current mimerical approach, or for stanHarH cycle pypan- 
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larger A the expansion appears to be converging, albeit 
slowly. 

In conclusion: What are the optimal methods for de- 
termining the long time properties of stochastic systems? 
The strong noise case is best treated by numerical evalu- 
ation of the trace, described here, requiring little knowl- 
edge of the underlying dynamics. The elements of peri- 
odic orbit theory, traces and determinants indeed survive 
strong noise, and converge rapidly, without reference to 
periodic orbits. The weak noise case depends on this un- 
derlying dynamics: for the hyperbolic case (A > 4), the 
cycle perturbation theory of |]l0| , |lT| or numerical evalu- 
ation; for noise induced escape from a strongly chaotic 
attractor (A « 4), the analytic methods of ||l5|; and for 
tunneling from a stable fixed point, analytic approaches 
analogous to quantum mechanics. The intermittent case 
with weak noise remains an open problem; the results 
here show that weak noise does not substantially regu- 
larize cycle expansions of intermittent systems, at least 
with respect to the rate of convergence. 

The author is grateful for helpful discussions with V. 
Baladi and P. Cvitanovic. 
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A 


Type 


0.01 


0.03 


a 
0.1 


0.3 


1 





Pure noise 


12.7 


12.7 


12.4 


12.7 


12.6 


1 


Intermittent 


-2.3 


-0.8 


1.2 


3.8 


8.5 


2 


Stable 1-cycle 


2.5 


2.2 


2.1 


5.9 


11.8 


3 


Bifurcation 


-0.3 


0.7 


2.8 


7.4 


13.2 


3.5 


Stable 4-cycle 


0.3 


1.4 


3.4 


7.8 


13.2 


3.57 


oo-cycle 


0.4 


1.1 


3.6 


7.8 


13.3 


3.72 


Chaos 


1.5 


1.4 


4.1 


8.0 


13.4 


3.84 


Stable 3-cycle 


1.6 


2.4 


4.6 


8.1 


13.4 


4 


Ulam map 


2.2 


2.9 


4.9 


8.2 


13.8 


5 


Repeller 


9.2 


9.1 


8.4 


9.1 


13.3 



TABLE I. Convergence of the spectral determinant, as 
measured by — logj^Q [Csl, where C5 is the coefficient of z'' 
in the cumulant expansion ^ for various types of dynamics 
of the logistic map Larger numbers imply faster conver- 
gence, giving roughly the number of converged digits in the 
escape rate calculated to n = 4. 
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